Web Survey Bibliography
Title The reliability and internal consistency of an Internet-capable computer program for measuring utilities
Author Lenert, L. A.
Source Quality of Life Research, 9, 7, pp. 811-817
Year 2000
Database Kluwer Journals
Access date 20.07.2004
Abstract Objective: The purpose of this study was to assess the reliability and internal consistency of measurements of utilities performed with a computer program (iMPACT2) designed for Internet surveys and Internet patient decision-support systems. Methods: We implemented the Internet Multimedia Preference Assessor Construction Tool, version 2 (iMPACT2) program using the combination of a web server, HTML files, and a web-accessible database. The program randomized subjects, screened their responses for missing data and failures of internal consistency, assisted patients with resolving certain inconsistencies, and, upon a subject's completion of the protocol, provided a report of results to the research assistant administering the program. To validate the iMPACT2 program, we recruited 60 healthy community volunteers and elicited preferences in a research-lab setting using a visual analog scale (VAS) and the standard gamble (SG) for subject's current health and three hypothetical states. For purposes of comparison, we also administered a Short Form-12 (SF-12) health-assessment questionnaire. Subjects used the computer software on two occasions separated by 2–4 weeks of time. Results: Visual analog scale and standard gamble ratings for subjects' current health were reliable (intraclass correlation coefficient (ICC) of 0.82 and 0.84 (two outliers excluded - 0.60 without exclusions), respectively) were comparable with the reliability of the Physical and Mental Component scales of the SF-12 (ICCs of 0.84 and 0.75, respectively). Subjects could easily discriminate between hypothetical states (D scores 0.74 for SG and 0.90 for VAS), and 94% had a completely internally consistent ordering of preference ratings for states. Conclusions: iMPACT2 produces measurements of standard gamble utilities that are reliable and have a high degree of internal consistency. Procedures for assessment of utilities developed for desktop computer programs can be translated to software designed for the Internet, facilitating the use of utilities and endpoints in clinical trials and development of web-based decision-support applications for patients. However, further testing, including direct comparisons with traditional interviewer administered utility elicitation protocols, is needed.
Access/Direct link Kluwer Journals (full text)
Year of publication2000
Bibliographic typeJournal article
Web survey bibliography - 2000 (46)
- Pollsters Inside the Box; 2000; Clark, R.
- The threat of satisficing in surveys: The shortcuts respondents take in answering questions; 2000; Krosnick, J. A.
- Designing Web Usability; 2000; Nielsen, J.
- Comparison of telephone, mail, Web, and IVR surveys of drugs and alcohol use among University of Georgia...; 2000; Bason, J. J.
- The measurement of personal values in survey research: A test of alternative rating procedures; 2000; McCarty, J. A., Shrum, L. J.
- Model of behavioral intention. A two-factor motivational model of behavioral intention; 2000; Thomas, R. K.
- DMS/AOL's Opinion Place expands research services to offer broadest online representation available...; 2000
- Research Report: The Evolving Relationship Between General and Specific Computer Self-Efficacy—...; 2000; Agarwal, R., Sambamurthy, V., Stair, R.
- Old, new make up today's surveys.; 2000; James, D.
- Software Comes Down to Earth; 2000; Macer, T.
- Using Web questionnaires for judgement and decisoin making research; 2000; Baron, J., Siepmann, M.
- Tell me, what did you see? The stimulus on computers; 2000; Krantz, J. H.
- Computer software and qualitative analysis: trends, issues and resources; 2000; Lee, R. M., Esterhuizen, L.
- Web and Mail Survey: Comparison on a Large-Scale Project; 2000; Kennedy, J. M., Kuh, G. D., Li, J., Hayek, J., Inghram, J., Bannister, N., Segar, K.
- Method and Representation in Internet-Based Survey Tools: Mobility, Community, and Cultural Identity...; 2000; Witte, J. C., Amoroso, L. M., Howard, P. E. N.
- Developing Usability Guidelines for AudioCasi Respondents with Limited Literacy Skills; 2000; J., Schneider, S. J.
- Technology Effects: Do CAPI or PAPI Interviews Take Longer?; 2000; Fuchs, M., Couper, M. P., Hansen, S. E.
- What Users Want From a Tool for Analyzing and Documenting Electronic Questionnaires: The User Requirements...; 2000; Kelly, M.
- Documentation for 2000 Presidential Election Internet Survey; 2000; Alvarez, M. R., Sherman, R.
- Internet Panel Response To The 'State Of The Union' Address: An Experiment; 2000; Frankovic, K. A.
- Current Practices in Intraspinal Therapy - A Survey of Clinical Trends and Decision Making; 2000; Hassenbusch, S. J., Portenoy, R. K.
- Online qualitative research task force: report of findings; 2000; Sweet, C., Walkowski, J.
- International growth of Web survey activity; 2000; MacElroy, B.
- Using online focus groups for e-commerce research; 2000; Johnson, W.
- The future of online research; 2000; James, D.
- Taking It To The Web; 2000; Grant, A. T., Dispensa, G.
- An opposing view of online surveying; 2000; Gorman, J. W.
- You've got surveys; 2000; Lipke, D. J.
- Developing usable Web sites - a review and model; 2000; Cunliffe, D. V.
- Impact of measurement periods on website rankings and traffic estimation: a user-centric approach; 2000; Lee, Su., Leckenby, J. D.
- The power of online research; 2000; Taylor, H.
- Report from Portland. AAPOR conference focuses on Web research; 2000; Totten, J. W.
- Psychological Experiments on the Internet; 2000; Birnbaum, M. H.
- A Brief History of Web Experimenting; 2000; Musch, J., Reips, U.-D.
- Potential of the Internet for Personality Research; 2000; Buchanan, T.
- Using the Internet for survey research: A case study; 2000
- Leverage-saliency theory of survey participation; 2000; Groves, R. M., Singer, E., Corning, A.
- E-interviewers add human touch to Web-based research; 2000; Wygant, S., Feld, K. G.
- Variables influencing dropout rates in Web-based surveys; 2000; MacElroy, B.
- Research non-stop; 2000; Grecco, C.
- Measuring response rates in online surveys; 2000; MacElroy, B.
- Content Analysis of the World Wide Web: Opportunities and Challenges; 2000; Weare, C., -Y., Lin, W.-Y.
- Banner-advertised Web surveys; 2000; Tuten, T. L., Bosnjak, M., Bandilla, W.
- Use of E-Mail And Internet Surveys By Research Companies; 2000; Totten, J. W.
- A Comparison Of Mail, Fax, And Web-Based Survey Methods; 2000; Cobanoglu, C., Warde, B., Moreo, P. J.
- Introduction: Survey and Statistical Computing in the New Millennium; 2000; Banks, R.